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LARGE  DEVIATIONS  FOR  DIFFUSIONS  DEPENDING 
ON  SMALL  PARAMETERS:  A STOCHASTIC  CONTROL  METHOD 


Wendell  H.  Fleming 


ABSTRACT 


This  paper  considers  stochastic  differential  equations  depending  on 
a small  parameter  e,  which  enters  as  a coefficient  in  the  noise  term  of  the 
equation.  The  Ventcel-Freidlin  estimates  give  an  asymptotic  formula  as 
e ->■  0 for  the  probability  that  a solution  trajectory  hits  a given  compact 
set  B during  a given  time  interval.  A stochastic  control  method  to  obtain 
such  estimates  is  outlined.  Detailed  proofs  are  given  elsewhere. 

£ 

1.  The  problem.  Consider  a Markov  diffusion  process  C on 
n-dimensional  R°  which  obeys  the  stochastic  differential  equations 


(1.1) 


dC^  = b[t,5'^(t)]dt  + /e  a[t,^^(t) ]dw,  s < t. 


with  initial  data  5 (s)  = x.  Here  w is  an  n-dimensional  brownian  motion 
and  e a positive  parameter.  Let  B be  a compact  set,  B CR*',  and  let  T 
denote  the  first  time  t such  that  5^(t)  G B.  If  ^^(t)  G R°  - B for  all 


(1.2) 


we  set  Tg  = +00.  Given  T > s,  let 


.P(X'<T). 
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Let  us  also  consider  the  unperturbed  system 


(1.3)  dC°  = b[t,^;°(t)]dt,  8 < t, 

with  the  same  initial  data  ^^(s)  ® x.  If  Tp  > T,  then  0 as  e -»■  0. 

B B 

The  Ventcel-Freidlin  estimates  [3],  [5]  give  a more  precise  statement  about 

e 

the  rate  of  convergence  to  0 of  q„,  under  certain  assumptions  about  the 

coefficients  b,0  in  (l.l)  and  the  set  B.  A different  method,  based  on 

stochastic  control  ideas,  was  used  in  [l],  [2]  to  obtain  estimates  of 

Ventcel-Freidlin  type.  In  this  note  we  outline  this  stochastic  control 

£ 

method,  as  it  applies  to  the  problem  of  estimating  q . 

B 

2.  Upper  and  lower  estimates.  Let  us  assume  that  b is  Lipschitz 
on  r"  , and  that  a together  with  its  inverse  O axe  bounded  and 

Lipschitz.  Some  results  in  which  a degenerates  in  a particular  way  appear 
in  [U].  Let  a = 00',  and  consider  the  variational  integrand 

(2.1)  L(t,<)),^)  = I (b(t,(j))  - <i')'a"^(t,(|>)(b(t,(|))  - «f). 

Let 


Fg  = {4>  € C([s,T];R"):  (})(s)  = x,  3 0 g [s,T]  9 <{>(0)  G B} , 


(2.2) 


* min  L[t,<|>(t)  ,<(>(t)]dt. 

Js 


(The  integral  on  the  right  side  is  defined  to  be  +"  if  <p  is  not 
absolutely  continuous . ) Let 

(2.3)  Ig  = -e  log  qg. 

e 

Theorem  1.  I_  < lim  inf  I„. 

® ■ e-0  ® 

e 

This  theorem  gives  an  upper  estimate  for  q^.  We  shall  outline  a 
stochastic  control  proof  in  §3,  and  refer  to  [2]  for  details. 

In  order  to  state  a lower  estimate,  we  make  the  following  additional 
assumption:  There  exists  a relatively  open  set  F®  C F^  such  that 


(2.1*) 


inf 


L[t,<|)(t),<t)(t)]dt  = I, 


* s 


By  relatively  open  we  mean  that  given  4'  € 

E C([s,T]  ;R'^)  , 'i<(s)  = X and  | 1 1 < <5  imply  i)*  G T 


there  exists 
0 

B* 


6 > 0 such  that 


Theorem  2.  If  (2.1*)  holds,  then  I„  > lim  sup  I„. 

— B - e-^.0  ® 


Theorem  2 is  an  immediate  consequence  of  the  first  Ventcel-Freidlin 

estimate  [3,  p.  332].  That  estimate  is  rather  easily  obtained  from  the 

Girsanov  formula.  On  the  other  hand,  the  usual  proof  of  Theorem  1 is  based 

on  a somewhat  more  technically  complicated  second  Ventcel-Freidlin  estimate 

[3,  p.  33I*].  Our  method  furnishes  an  alternative  proof,  as  well  as  a 

different  intuition  for  arriving  at  such  results. 

e 

From  Theorems  1 and  2 one  has  Ig  ■+■  Ig  as  e -►  0,  which  is  the 
desired  result  about  the  probability  of  large  deviations. 


3.  Stochastic  control  method.  Let  us  fix  T > 0 and  consider 

n £ E 

0 < s < T.  Let  Q = (0,T)  (R  -B),  and  write  q = q (s,x).  Then 

£ T p DO 

q EC  ’ (Q)  and  satisfies  in  Q the  backward  partial  differential  equation 
B 

e 


(3.1) 


3q;  £ n ^ ^ 3^qg  n 3q, 


1=1  1 


£ E 

The  function  = -e  log  q„  satisfies  the  nonlinear  equation 
B B 

3j.£  ^ g2^e 

^3-2)  ^ + f ^ t 3^;^  ^ H(s,x.V$^)  = 0. 

1 j j—X  1 j 


where  for  each  row  vector  p 


(3.3)  H(s,x,p)  = - ^ pa(s,x)p'  + p.b(s,x). 

The  function  H(s,x,.)  is  dual  to  L(8,x,*),  in  the  sense  of  duality  for 

concave  and  convex  functions.  If  one  puts  formally  £ = 0 in  (3.2),  one 

gets  the  Hamilton-Jacobi  equation  associated  with  the  variation*^  Integrand  L. 

The  fact  that  T includes  only  curves  <P  which  reach  B by  time  T 
B g 

corresponds  formally  to  the  coniJition  q (T,x)  = 0 for  x ^ B,  and  hence 

c ® 

I„(T,x)  = ■♦«>.  The  connection  with  the  Hamilton-Jacobi  equation  indicates, 

B 


but  of  course  does  not  prove,  results  of  the  kind  stated  in  §2. 


Lemma.  Let  B = 3D,  vhere  D C is  open,  bounded  vith 
boundary  3D.  Then  i,  < lim  inf  I„,  for  any  (s,x)  E (O.T)  ^ D. 

^ “ e-H)  ® 


This  result  is  proved  in  [2,  §7]»  by  an  argument  which  we  sketch 
below.  From  the  Lemma,  Theorem  1 is  obtained  as  follows.  There  exist 


D1CD2C... 

of  class 

B = 3d 
n n 


, with  union  R - B,  such  that 

-1 


and  B 


n 


3d  = B U { I X I = n} , with 
n n ' ' 

We  take 


contained  in  the  n -neighborhood  of  B 
e e 
•B  ^ '1b 

n 


lim  inf  > lim  inf  > I . 
e->o  ® • e-vo  ®n’  ®n 

Moreover,  I -*-1  as  n 

B D 

n 

The  proof  in  [2,  §7]  of  the  Lemma  is  based  on  a "penalty"  function 
method.  Let  $(x)  be  Lipschitz,  with  $(x)  > 0 for  x ^ 3D,  il>(x)  = 0 for 
X E 3D.  Let  J^(s,x)  be  the  solution  of  (3.2)  in  (0,T)  ^ D,  with 
J (s,x)  = 0 for  0 < s < T,  X G 3D,  J (T,x)  = <Ii(x).  Then  J (s,x)  satis- 
fies the  dynamic  programming  equation  for  an  optimal  stochastic  control 
problem  in  which  the  drift  term  b[t,&^(t)l  in  (l.l)  is  replaced  by  an 
arbitrary,  bounded,  nonanticipative  control  process  v(t).  Instead  of  (l.l), 
one  now  has  the  stochastic  differential  equation 


dn  = v(t)dt  + /e  a[t,n(t) ]dw. 


The  quantity  to  be  minimized  is 

,0 


E{[  L(t,n(t), 

' a 


v(t))dt  + 'i>[0,n(0)]}. 


where  6 = min(T,  exit  time  from  D of  n(t)).  The  minimum  of  this  ex- 

Lm  i 
e-K) 


£ £ 
pression  is  J (s,x).  It  is  shown  in  [2]  that  lim  inf  J > J,  where  J(s,x) 


is  the  minimum  of  L[t,<j>(t) ,^(t) ]dt  4'[0,^(0)]  taken  among  all  (<)>,6) 

' s 

with  <P(b)  = X and  either  0 = T or  0 < T,  ^(0)  G 3D.  For  M = 1,2,... 

we  now  take  41  = ♦,,  = MS'  for  fixed  >?,  and  write  = J^,  J = J^.  It  is 
M 

easy  to  show  that  I < lim  inf  J^.  Moreover,  < I^.  Then  < lim  inf  I^ 

Rw  “ “ £-+-0  ” 


for  each  M,  from  which  the  Lemma  follows. 
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